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Abstract 

We derive standard imsets for undirected graphical models and 
chain graphical models. Standard imsets for undirected graphical mod- 
els are described in terms of minimal triangulations for maximal prime 
subgraphs of the undirected graphs. For describing standard imsets 
for chain graphical models, we first define a triangulation of a chain 
graph. We then use the triangulation to generalize our results for the 
undirected graphs to chain graphs. 
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1 Introduction 

The notion of imsets introduced by Studeny [T7] provides a very convenient 
algebraic method for encoding all conditional independence (CI) models 
which hold under a discrete probability distribution. However, a class of 
imsets does not satisfy the uniqueness property: a number of different imsets 
represent the same CI model. 

Thus some questions related to the uniqueness property arise [T7]. One of 
them is the task of characterizing equivalent imsets. For example, in the case 
of classical graphical models |10] . their equivalence classes are characterized 
by Andersson et al. [T] and Frydenberg [3] in graphical terms. Studeny [14j 
related a CI model induced by a imset to some face of a special polyhedral 
cone, and an algorithm for CI inference based on this cone is studied in [2]. 
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Another question is to find a suitable representative for every equivalence 
class. This is motivated by a practical question about learning CI models 
(see Section 4.4 in [T6] and Section 4 in [22J). As a subproblem of this, 
explicit expressions of imsets for important classes of graphical models, such 
as directed acyclic graphical (DAG) models and decomposable models, are 
given in [IT]. Imsets for some chain graphical (CG) models are also known 
[19j . They are called standard imsets and have attractive simple forms. One 
of their advantages is that they give a simple method to test whether two 
graphs have the same CI model. Another advantage is that it provides a 
translation of graphical models into the framework of imsets. Thus standard 
imsets offer a new algebraic approach for learning graphical models [20' "8] 

In this paper we derive standard imsets for undirected graphical (UG) 
models and general CG models. Our standard imsets generalize those for 
DAG models and decomposable models. For UG models we consider all 
minimal triangulations of an undirected graph in accordance with maximal 
prime subgraphs and then use the standard imsets for minimal triangulations 
(which are decomposable models) for defining our standard imset. For CG 
models we first define a triangulation of a chain graph. We then use the 
triangulation to generalize our results for undirected graphs to chain graphs. 

The organization of the paper is as follows. In Section [2] we summarize 
basic definitions and known facts on imsets and graphs, including standard 
imsets for DAG models and decomposable models. In Section [3] we derive 
standard imsets for UG models. In Section [5] we introduce a notion of 
triangulation of a chain graph and based on the triangulation we derive 
standard imsets for CG models. We conclude the paper with some remarks 
in Section [H 

2 Preliminaries 

In this section we summarize our notation, definitions and relevant pre- 
liminary results concerning conditional independence, imsets and graphical 
models. 

2.1 Conditional independence and imsets 

First we set up notation for conditional independence and imsets following 
Studeny [H]. 

Let be a finite set of variables and let V{N) = {A : A C A^} denote 
the power set of N . For convenience, we write the union A\J B oi subsets 
of N as AB. A singleton set {i} is simply written as i. As usual, M, 



2 



Z, N denote reals, integers and natural numbers, respectively. For pairwise 
disjoint subsets. A, B,C C N, we write this triplet by {A, B \C), and the set 
of all disjoint triplets {A, B \ C) over N by T{N). As usual, for a probability 
distribution P over A^, A _LL i? | C [P] denotes the conditional independence 
statement of variables in A and in B given the variables in C under P. The 
case C = corresponds to the marginal independence of A and B. In this 
paper, we regard a triplet {A, B\C) as an independence statement. Then 
the set of conditional independence statements under P is denoted as 

>[p = {{A,B\C) G T{N) : AALB\C[F]}. 

We call A4p the conditional independence model induced by P. 

An imset over N is an integer-valued function u : V{N) Z, or alter- 
natively, an element of Zl^^^^l = Z^'^'. The identifier 5a of a set A C A is 
defined as 

B^A,B<ZN. 

For a triplet {A, B\C) ^ T{N), a semi- elementary imset U(^a,b \ c) is defined 
as 

U{A,B I C) = 5 ABC + 5c - 5 AC - ^BC- 

li A = a and B = b are singletons, the imset u^^j | is called elementary. 
The set of all elementary imsets is denoted by £{N). Let cone(£'(A)) C M^'^' 
be the polyhedral cone generated by all the elementary imsets. It can be 
shown that every elementary imset is a generator of an extreme ray of the 
cone(£^(A)) |14] . A combinatorial imset is an imset which can be written 
as a non-negative integer combination of elementary imsets. The set of all 
combinatorial imsets is denoted by C{N). Let 

5(A) = cone(^(A))nZl^(^)l. 

An element of 5(A) is called a structural imset. Note that C(A) C 5(A) by 
definition, however, it is known that this inclusion is strict for |A| > 5 [7]. 

A conditional independence statement induced by a structural imset is 
defined as follows: 

Definition 2.1. For u € 5(A) and a triplet {A,B\ C) € T(A), we define a 
conditional independence statement with respect to u as 

AALB\C[u] 3A; G N, k-u- U(^a,b | c) G ^(A). 
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The independence model induced by u is denoted by 



M 



{{A,B\C) G T{N) : AALB\C[u]}. 



It can be shown that the structure of conditional independence models 
induced by structural imsets depends only on the face lattice of cone(£'(A^)), 
not on each imset [14]. Therefore implications of conditional independence 
models induced by imsets correspond to those of faces of cone(i*-(A^)). Next 
lemma, which is very useful for our proofs in later sections, follows from this 
fact. 



The method of imsets is very powerful, because conditional independence 
models induced by discrete probability measures are always represented by 
structural imsets. 

Theorem 2.3. (Studeny il71) For every discrete probability measure P over 
N, there exists a structural imset u G S{N) such that A4u = Mp. 

2.2 Graphs and graphical models 

Here we summarize relevant facts on graphs and graphical models following 
Lauritzen ^Oj, Studeny, Roverato and Stepanova[19j, Leimer [Tl], and Hara 
and Takemura |5j. 

Throughout this paper, we consider a simple graph G = {V{G), E{G)), 
V{G) = N, E{G) CNxN. An edge (a, b) G E{G) is undirected if (6, a) G 
E{G). We denote an undirected edge by o — b. If (6, a) ^ E{G), we call 
(a, b) directed and denote a ^ b. An undirected graph (UG) contains only 
undirected edges, while a directed graph contains only directed ones. The 
underlying graph of a graph G is the undirected graph obtained from G by 
replacing every directed edge with an undirected one. For a subset 5* C iV, 
Gs denotes the subgraph of G induced by S. A graph is complete if all 
vertices are joined by an edge. A subset if C is a clique if Gk is complete. 
In particular, an empty set = is a clique. A clique K is maximal if no 
proper superset K' D K is a clique in G. JCg denotes the set of maximal 
cliques of G. 

Two vertices a,b G N are adjacent if (a, 6) G E{G) or (6, a) G E{G). If 
a ^ b, then a is a parent of b and 6 is a child of a. For a vertex c G A^, we 
denote the set of parents and the set of children of c in G by pag.(c) and 



Lemma 2.2. (Studeny fHf ) For u,u' G S{N) 
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chG(c), respectively. For a subset C C N, let pa(j(C) = UcecP^G(c) \ C 
and chG'(C) = {J^^Qchoic) \ C. We will omit subscript G if it is obvious 
from the context. 

A path of length k from a to 6 is a sequence a = ci, . . . ,Cfe_|_i = 6 of 
distinct vertices such that (cj,Cj_|_i) G -E'(G) for i = 1, . . . , A;. If a path 
contains only undirected edges, it is an undirected path and otherwise (i.e. 
it contains at least one directed edge) directed. A vertex a G iV is an 
ancestor of b € N ii there exists a path from a to 6. Let anG'(a) be the set 
of all ancestors of a. The ancestral set anc(C) of a subset C C AT is defined 
as anG'(C) = UceC ^'^g(c). Let Ci, . . . , a path with (cfe, ci) G E{G). Then 
we call the sequence ci, . . . , c^., ci a cyc/e of length /c. Analogously to paths, 
a cycle is undirected if it contains only undirected edges, otherwise directed. 
A directed acyclic graph (DAG) is a directed graph containing no directed 
cycles. 

A subset C C A^ is said to be connected if there exists an undirected path 
form a to 6 for all a, 6 G C in the subgraph Gc- A connectivity component 
of G is a maximal connected subset in G with respect to set inclusion. 
The connectivity components in G form a partition of A^. A chain graph 
(CG) G is a graph whose connectivity components Ci, . . . , Cm are ordered 
such that every edge a ^ 6 G E{G) with a G Cj, 6 G Cj for i < j is 
directed. Equivalently, a chain graph is defined as a graph containing no 
directed cycles. The connectivity components of a chain graph are called 
chain components. The set of chain components of a chain graph G is 
denoted by Co- The chain components are most easily found by removing 
all directed edges from G before taking connectivity components. Both 
undirected graphs and directed acyclic graphs are chain graphs. In fact, 
a chain graph is undirected if m = 1, and directed acyclic if each chain 
component contains only one vertex. Suppose two chain graphs G, H have 
the same underlying graph. Then we say H is larger than or equal to G if 
a — b G G implies a — b G H. In this case, we write H > G. By definition, 
H has more undirected edges than G if if is larger than G. 

We now discuss maximal prime subgraphs of an undirected graph G. A 
non-empty subset $ ^ S C N is a separator if the number of connectivity 
components increases when S is removed from G. 5 = is a separator if 
(and only if) G is not connected. A separator S" is a clique separator if S 
is a clique. For two vertices u,v E N with u — v ^ E{G), a separator S is 
called a {u, v) -separator if u and v belong to different components of Gj^\s- 
A minimal vertex separator is a minimal {u, f )-separator for some u,v & N 
with respect to set inclusion. For {A, B \C) € T{N), we say that A and B 
are separated by C if G is (a, 6)-separator for all a G A and b & B. 
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A graph G is prime if G has no chque separators. Let Gy, V N , 
be prime. Then Gy is a maximal prime subgraph (mp-subgraph) and V 
is a maximal prime component (mp-component) of G, if there is no proper 
superset V D V such that Gy' is prime. The set of mp-components of G is 
denoted by Vq- There exists an order Vi, . . . , Vm,m = |Vg|, of Vq such that 



This sequence is said to be D-ordered, or alternatively, to have a running 
intersection property (RIP) [lOj. For each i, Si is a clique minimal vertex 
separator. Define Sq = {5*2, . . . , 5^,}. Then Sg is the set of all clique 
minimal vertex separators in G. Moreover, the number of 5 € Sg which 
appears among 5*2, ... , Sm may be more than one. This number is called 
the multiplicity of S in G, and written as vg{S)- For any undirected graph 
G, Vg-,Sg and {i'g{S)}s&Sg ^'"^ uniquely defined [TTj . 

In graphical models, the class of models induced by decomposable graphs 
are well studied, because it has many good properties. There are several 
equivalent definitions of decomposable graphs. One of them is based on 
the decomposability of graphs. For an undirected graph G and a triplet 
{A, B I G) with iV = yl U U G, we say that {A, B \ G) decomposes G into 
the subgraphs Gac o,nd Gbc if G is a clique and separates A and B. The de- 
composition is proper if A,B ^ 0. An undirected graph G is decomposable 
if it is complete or there exists {A, B \ G) which properly decomposes G into 
decomposable subgraphs Gac and Gbc- Decomposable graphs are charac- 
terized in the terms of mp-subgraphs by Leimer [11] . An undirected graph G 
is decomposable if and only if all mp-components of G are cliques. Further- 
more, for every undirected graph G with mp-components 14, ... , Vm G Vg, 
there exists a decomposable graph G' such that Vi , . . . , Vm are maximal 
cliques of G'. The graph G' is obtained by adding edges in such a way that 
Vi, . . . , Vm are cliques. 

Another equivalent definition is a chordal graph, or alternatively trian- 
gulated graph. An undirected graph is chordal if every cycle of length more 
than or equal to four has a chord. An undirected graph is chordal if and 
only of it is decomposable |10i . 



2.3 Conditional independence models induced by graphs 

Here we summarize known facts on conditional independence models in- 
duced by graphs. 



Vi € {2 



. . . ,m},3A: G {1, . . . ,i - 1}, 5, = n (J l/j C Vfc. 
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For directed acyclic graphs, there are two equivalent separation criteria 
d-separation [13\ [2T] and moralization [9j. However we omit their details 
because we do not need them in this paper. For a triplet {A, B \C) £ T{N), 
we write ^ _LL S | C [G] if ^ and B are separated given C by these criteria. 
Every directed acyclic graph G induces the formal independence model 

MG = {{A,B\C)eT{N):AALB\C[G]}, (1) 

which we call a DAG model. A probability measure P over N is Markovian 
with respect to a directed acyclic graph G if Aic ^ -^P and perfectly 
Markovian if the converse implication also holds. 

For an undirected graph G and {A, B\G) £ T{N), we have AALB\C[G] 
if A and B are separated by C in G I13j . A UG model A4g is again 
defined by ([1]). The definitions of a Markovian and a perfectly Markovian 
measure are analogous to the case of DAG models. It is known that a 
perfect Markovian discrete measure exists for every undirected graph [3]. 
A decomposable model is defined as an independence model induced by a 
decomposable graph. A decomposable model is simultaneously a UG model 
and a DAG model. 

Finally we discuss chain graphs. The popular separation criterion for 
chain graphs is moralization [4]. For a chain graph G and a triplet {A, B \G) £ 
T{N), let H = Gan(ABC)- A moral graph H"^"^ of H is the undirected graph 
obtained by adding an undirected edge a — b to the underlying graph of H 
whenever there is a chain component G' G Ch such that a,b £ pa(C") and 
a and b are not adjacent inH. We define A AL B \G [G] if A AL B \G [H"^"'] 
holds. The definitions of a CG model, a Markovian measure and a perfectly 
Markovian measure are analogous to the other graphs. It is known that a 
perfect Markovian discrete measure exists for every chain graph |15j . 

An important concept about chain graphs is equivalence for graphs [17j . 
We say that G and H are equivalent if A4g = Mh- Equivalent chain graphs 
are characterized by Frydenberg [3]. A complex in G is an induced subgraph 
of G of the form cq — > ci — • • • — Ck ^ Ck+i, k > 1, and no other edges 
between cq, ci, . . . , c^+i exist in G. 

Theorem 2.4. (Frydenberg J^) Two chain graphs are equivalent if and only 
if their underlying graphs coincide and they have the same complexes. 

More important fact is that every equivalence class has one distinguished 
representative. 

Theorem 2.5. (Frydenberg J4^l) Every equivalence class % of chain graphs 
has the largest element H^o € H such that H < for all H £%. 
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H 

Figure 1: A decomposable graph H. 



2.4 Standard imsets for directed acyclic graphs and decom- 
posable graphs 

Let G be a directed acyclic graph. A standard imset for G is defined as 
follows [IT]: 

UG = - S(D + X^{'^pa(j) - <^{i}Upa(i)}- (2) 

This standard imset is a unique representative for equivalent graphs. 

Lemma 2.6. (Studeny I17f ) Let G a directed acyclic graph. Then ug G 
C{N) and A4g = J^uc hold. Moreover, for a directed acyclic graph G' , 
A4g = if o,nd only if ug = ug' ■ 

A standard imset for a decomposable graph H is defined by the sets of 
maximal cliques and clique minimal vertex separators in H [17] : 

UH = Sn - ^ 6k + ^ I'HiS) ■ 5s. (3) 

Example 2.7. Put N = {a,b,c,d,e} and consider the decomposable graph 
H shown in Figure [TJ The sets of maximal cliques and clique minimal 
vertex separators in H are JCh = {abc, acd, cde} and Sh = {ac, cd} (with 
multiplicities UHiac) = vnicd) = 1). Then the standard imset for H is 

UH = Sabcde — ^abc — ^acd — ^cde + ^ac + Scd 
= U(^b,e I acd) + W(a,e | cd) + U(^b,d \ ac) ■ 

For a complete graph, its standard imset is the zero imset. 

Since decomposable models can be viewed as DAG models, their imsets 
([2|) and Q lead to the same imset. 

Lemma 2.8. (Studeny \17^ ) For every decomposable graph H , there exists 
a directed acyclic graph G such that Mg = -^iT o-iT-d ug = uh- 
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This imphes that for a decomposable graph we have uh G C.{N) and 
Mh = -Muh from Lemma [221 

As discussed in Section [H these imsets for directed acychc and decompos- 
able graphs are not the only combinatorial ones representing their graphical 
models. However they are the simplest, "standard" representations [2]. A 
standard imset gives a simpler criterion of testing a conditional indepen- 
dence statement than other imsets. 

Lemma 2.9. (Bouckaert et al. f^) For a directed acyclic (resp. decompos- 
able) graph G, {A,B \C) € if and only if uq — ^(a,_b|c> S C{N), which 
is also equivalent to uq — U(^a,b\C) ^ where ug is the standard imset 

in ([2]) or ©. 

3 Standard imsets for general undirected graphs 

In this section we derive imsets for general undirected graphs. Our con- 
struction is based on a concept of a triangulation. 

3.1 General undirected graphical models 

For generalizing the result of decomposable graphs to general undirected 
graphs, consider constructing a decomposable graph from a given undirected 
graph by adding edges. The resulting graph is called a triangulation of the 
input graph [6]. A triangulation G' of G is minimal if there is no trian- 
gulation G" of G such that E[G") C E[G'). In general, there are many 
minimal triangulations of a graph. As for separations of an input graph and 
a minimal triangulation, the following lemma holds. 

Lemma 3.1. For every undirected graph H and a triplet {A,B \ G) G Mh, 
there exists a minimal triangulation H' of H such that {A,B \C) € Mh'- 

Proof. It suffices to show the existence of a triangulation H' such that 
{A,B\G) G M.H'- In fact, if H' is not minimal, we can obtain a mini- 
mal triangulation by removing edges from H' , because removing edges does 
not destroy the relation AALB\G. 

We construct a desired triangulation as follows (see Figure [2]) . Let N = 
A yj B' yj C' yj D' be a partition of the vertex set such that 

A' = {i & N : i is connected with A in Hj\f\(j}, 
B' = {i G N : i is connected with B in -f/^ivyc}, 
C' = G and D' = N\ A'B'G'. 
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H H' 
Figure 2: A construction of H' from an undirected graph H in Lemma |3. II 



Construct the graph H' by adding edges so that H'j^,^,, H'^,^, and H'^,^, 
are cliques. This H' is clearly decomposable, and hence, a triangulation of 
H. From the construction. A' and B' are not connected to each other in 
H'j^^ij,. Thus A C A' and B C. B' are not connected to each other in H'^^^^ 
which means (^4, B\C) ^ Mh'- □ 

For a general undirected graph, we can obtain an imset representing this 
UG model by using all minimal triangulations. The following theorem is the 
first main result of this paper. 

Theorem 3.2. Let H he an undirected graph and let denote the set 

of all minimal triangulations of H . Put 



VH = ^ UH': 



(4) 



where uh> for H' G T(-fr) are defined by Then vh G C-{N) and M.h 



M 



Vh ■ 



Proof. Since the class of combinatorial imsets is closed under the addition, 
it is evident that the imset vh is combinatorial. 

For every undirected graph H, there exists a discrete probability measure 
P with Ai-p = Mh [3]. Moreover, Theorem 12.31 implies that there is a 
structural imset w £ S{N) such that Aip = Mw- Then, for H' G ^{H), we 
have 

Mu„, = Mh' ^ Mh = Mp = My,, 

which implies kjj' ■ w — Uh' G S{N) for some k^i G N from Lemma 12.21 
Therefore, putting k = Yl,H'e%(H) ^H', it follows that k ■ w — vh £ S{N). 



That is, Mv„ C Mi 



M 



H- 
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Conversely, for every {A,B\C) € Mh, there exists H' £ ^{H) such 
that {A,B I C) € M.H' from Lemma IXTl Thus, uh' — ii(A,_B|c> € S{N) from 
Lemma 12.91 Hence we have 

VH -Ui^A,B\C) = ^ UH" + {uw - U(^A,B\C)) ^ S{N), 
H"e%(H)\H' 

which implies {A, B\C) e M^^. □ 

The imset vh in @ is a generalization of the case of decomposable 
graphs, because for a decomposable graph H, the set of minimal triangula- 
tions contains H only. An example of this imset is given in the next section. 



3.2 Some consideration toward a definition of standard im- 
sets for general undirected graphs 

The imset defined in the last section through all minimal triangulations has 
'extra' additional parts as shown in the following example. 

Example 3.3. Put N = {a, 6, c, d, e}. Consider the graph H in Figure [3] and 
its minimal triangulations Hi , H2 ■ Then the imset vh in (HD is 

VH = UHi + UH2 

= {^N — ^abd — hcd — ^cde + hd + ^cd) 

+ i^N — 5abc — Sacd - ^cde + ^ac + ^cd) 
= 2 • U(^ah,e I cd) + U(a,c | bd) + ""(b.d | ac) ■ 

It can be seen that abALe\cd holds in both Hi and H2- This is expressed as 
the coefhcient 2 of U(^ab,e\cd)- Now consider an imset uh with this coefficient 
1, that is, 

Vh = V(^ab,e I cd) + ^(a,c | bd) + ""(6,^ | ac) ■ (5) 
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Figure 4: A graph with an exponential number of minimal triangulations. 






(b) 



Figure 5: mp-subgraphs in the new imset. 



(c) 



From Lemma ETH {A, B\C) € Mh is equivalent to {A, S | C) G Mw for 
some minimal triangulation H' of H. Hence, for example, letting {A, B\C) ^ 
M-Hi-: we have 

UHi - U{A,B\c) e S{N) 

=^ UH-, + U(^h,d I ac) - U{A,B I C) e '5(iV) 
UH - U^A,B I C) G S{N) 

=^ {A,B\C)eMuH. 

Since the same result holds for {A, B\C) e Mh2^ we have Mv^ = Mh ^ 
MuH- Also, since vh — uh = U(^ab,e I cd) G <S{^)^ we have M.vh — Mujj from 
Lemma [221 Thus Mvh = = Mh- 

Note that a graph such as the one in Figure H] has an exponential number 
of minimal triangulations, which makes infeasible to calculate vh in (jH) 
actually. 

The above examples suggest that it suffices to use only minimal triangu- 
lations of each mp-subgraph and not of the whole of the graph. In particular, 
the new imset ([5]) in Example 13.31 seems to be defined as follows: First, con- 
sider the graph obtained by adding edges to the input graph in such a way 
that all mp-subgraphs are complete (Figure [5]- (a)), and consider its stan- 
dard imset {u(^ab,e\cd))- Next, for each mp-subgraph which is not complete, 
consider their minimal triangulations (Figure [5]-(b), (c)) and their standard 
imsets (^t(a,c | fed) ) | ac>)- We show in the following sections that this idea 
is correct. 
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3.3 Minimal triangulations and mp-subgraphs 

We show in this section that all minimal triangulations for an undirected 
graph are obtained by computing minimal triangulations for each mp-subgraph. 

The following fact gives the way of adding edges to obtain a minimal 
triangulation: 

Lemma 3.4. (Ohtsuki et al. U^ ) A triangulation H' of an undirected graph 
H is minimal if and only if for each u — v added by this triangulation, no 
{u, v)- separators of H is a clique in H' . 

Prom this lemma, we have the following result about the relation between 
mp-subgraphs and minimal triangulations of a graph. 

Lemma 3.5. For an undirected graph H , a graph H' obtained by a min- 
imal triangulation of each mp-subgraph is a minimal triangulation of H . 
Conversely, all minimal triangulations of H are obtained in this way. 

Proof. Let w he a cycle ai, . . . , a^, On+i = ai, n > 4, of length more than or 
equal to 4 in H' . Firstly, consider the case that w contains vertices of two 
different mp-subgraphs of H. Then w contains two vertices of some clique 
minimal vertex separator of H (hence in H') which are not consecutive in w. 
Thus the cycle w has a chord. We next consider the case {ai, . . . , a„} C V 
for some mp-component V G Vh in H- Since Hy is decomposable, the cycle 
w also has a chord in H' . Therefore H' is decomposable. Moreover, from the 
definition of a minimal triangulation, removing one edge from the resulting 
graph makes it non-decomposable. Thus the first statement is proved. 

The converse is shown by contradiction. For an edge u — v added by a 
triangulation H' of H, assume that u and v belong to different mp-subgraphs 
of H. Then u and v are separated by some clique minimal vertex separator 
of H from the definition of mp-subgraphs. Since this separator is also a 
clique in H' , H' is not a minimal triangulation from Lemma |3.4[ □ 

3.4 Definition and properties of standard imsets for undi- 
rected graphs 

We define a standard imset for an undirected graph using Lemma 13.51 

Definition 3.6. For an undirected graph H, a standard imset uh for H is 
defined as 

UH = 6n - ^ Sv + ^ i^h{S) -^s + ^ ^ UG, (6) 
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where for each G S %{Hv), V S Vh, uq is the standard imset given by ([3]): 

UG = 6v - Y ~^ Y ^G^^^ • ^s- 
K&K.G SdSa 

Note that, if H is decomposable, the last term of uh vanishes because 
all mp-components are cliques Thus this imset coincides with 
We show that this imset represents a UG model. 

Theorem 3.7. For an undirected graph H, define U}j as ©. Then € 
C{N) and Mh = Muh- 

Proof. The first three terms of ^ correspond to the standard imset for the 
decomposable graph such that all V E Vh are cliques. Thus, this imset is 
combinatorial, and hence, uh & C.{N). 

Let H' be a minimal triangulation of H. Since a minimal triangulation 
is done in each mp-subgraph from Lemma 13.51 the following relations hold: 

^H' n K,H' = 0, Sh' n Sh' = 0, VVi, V2 e Vh, ^1 V2, 

SHr\SH>^ = ^, vyeV/,, 

yH{S) = VH'{S), ySeSn. 
Hence a standard imset for the decomposable graph H' given by ([3]) is 

= ^N- Yl Y ^K+Y ''h{S)-6s+ J2 Y ''H'iS)-5s 

"v V 

= - Y + Y ^h{S) ■ 5s 

+ Y i^y- Y Y ''K-iS)-6s} 

V&Vh K&Kr,, SeSrr, 

"v V 

= 8n- Y ^y+Y ^h{S)-5s+ Y ""K- 

yeVn S&Sh VGVff 

Let Vh = J^H'eliH) ^H' given in dH). Then vh is written as 

VH = Y {^^~ Y ^y^Y ''h{S)-5s+ Y1 ^h[,] 
H'&{H) VeVH S&Sh V^Vh 
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= \%iH)\ .{s^- Sv+Yl ^h{S) ■5s}+ E ""K 

veVH seSH 

+ E E nHiV,G)-UG, 

where nniV, G) = \{H' G %{H) : H'y = G}\ for 1^ E V/f and G G T(i/y), is 
the number of minimal triangulations H' € ^{H) such that H'y = G. Note 
that uh in ^ is obtained by replacing the coefficients of the right-hand side 
by one. Thus uh and vh belong to the relative interior of the same face of 
cone(£^(A^)). Hence we have M.uh = -Mvu, which means ^Au„ = -Mh from 
Theorem [331 □ 



Example 3.8. Consider the graph H in Figure E] again. The sets of mp- 
components and clique minimal vertex separators are Vh = {abed, cde} and 
Sh = {cd}. Since V2 = cde is a clique, the minimal triangulation of its 
subgraph is itself. As for Vi = abed, the minimal triangulations of Hy^ 
are given in Figured (b), (c). Then the standard imset for in ([6]) is 

Uh = ^abcde — ^abcd — ^cde + ^cd 

+ i^abcd - Sabc - ^acd + Sac) + {^abcd — 5abd — hcd + hd) 
= U(ab,e I cd) + ""(a.c | bd) + U(b,d | ac) ; 

which coincides with ([5]). 

As in the case of directed acyclic graphs and decomposable graphs, our 
standard imset for an undirected graph provides a simpler criterion: 

Corollary 3.9. For an undirected graph H and every triplet {A, B \C) (z 
T{N), the fallowings are equivalent: 

(i) {A,B\C)(^Mh, 

(ii) UH - U{A,B\C) G C(iV), 
( Hi) UH - U(^A,B \c) (^S{N). 

Proof. The implication (ii) =^ (iii) => (i) is obvious from the definition. Thus 
we only need to consider the implication (i) =^ (ii). For {A, B \ C) G Mh, 
Lemma 13.11 implies that {A,B\C) G Mh' for some minimal triangulation 
H' of H. Hence uh> — ui^a^b \ c) ^ C(A^) from Lemma [2^91 For every V G Vh, 
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some minimal triangulation G of Hy coincides with H'y from Lemma I3.5i 
Thus uh — uh' S C{N) from ([7]), which imphes that 

UH - U(^A,B I C) = (uH -UH') + (uH' - U(^A,B | C> ) ^ C (iV) . 

□ 

Remark 3.10. In the case of directed acychc graphs and chain graphs, some 
graphs may induce the same conditional independence model, and we have 
to consider the uniqueness of standard imsets for these graphs (cf. Lemma 
12. 6p . However, in the case of undirected graphs, two graphs cannot have the 
same conditional independence model. Thus it is not necessary to consider 
the uniqueness. 

4 Standard imsets for general chain graphs 

In this section, we define a standard imset for a chain graph, which is a 
generalization of an undirected graph and a directed acyclic graph. Studeny 
and Vomlel [ISJ, and Studeny, Roverato and Stepanova [19] give standard 
imsets for chain graphs which are equivalent to some directed acyclic graph. 
Using this result, we can derive imsets for general chain graphs. Moreover 
we show that these imsets fully represent CG models by similar arguments 
as in the case of undirected graphs. In the later part of this section, we show 
the uniqueness of these imsets for equivalent chain graphs using the concept 
of feasible merging. 

4.1 Generalization of a triangulation to chain graphs 

Firstly, we introduce a concept which generalizes a triangulation of an undi- 
rected graph. In the case of an undirected graph, a triangulation of a graph 
is defined as a decomposable graph obtained by adding edges to the in- 
put graph. Since decomposable models can be interpreted as an undirected 
graph which is equivalent to some directed acyclic graph, we can define a 
triangulation of a chain graph in the same way. 

Definition 4.1. A chain graph H' = {V{H'), E{H')),V{H') = V{H) is 
said to be a triangulation of a chain graph H if H' satisfies that 

(i) a — be E{H') whenever a — b£ E{H), 
(n) a — > 6 G E{H') whenever a ^ b e E{H), and 

(iii) H' is equivalent to some directed acyclic graph G, that is, M.h' = -Mg- 
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(1) (2) (3) 

Figure 7: The closure graphs of Figure El 

The condition (iii) has been characterized by Andersson et al. [1] in 
graphical terms. For a chain graph H and a chain component C € Ch, a 
closure graph for C is defined as the moral graph //(C) = (-f/c'upa(c))™™- 

Proposition 4.2. (Andersson et al. JT^) A chain graph is equivalent to some 
directed acyclic graph if and only if H[C) is decomposable for every chain 
component C € Ch- 

Lemma 4.3. (cf. Remark ^.2 in f^) For a G N and A C N , let ch.A{a) = 
ch(a) D A be the set of all children in H that occur in A. For any chain 
component C E Ch, the closure graphH(C) = {Hcupa{c))"^°^ decomposable 
if and only if: 

(i) He is decomposable, 

(a) for every a € pa(C), and every non-adjacent pair c,d & chc(a), we 
have cALd\{ch.c{a)\cd)[Hc] (in particular ch.c{o)\cd ^ %), and 

(iii) for every distinct pair a,b £ pa(C), and every c G chc{a) \ chc(b),d € 
chc(6)\chc(a), we have cALd\ {chc{a) chc(b)\cd) [Hq] (in particular, 
chc{a) chc(6) \ cd and c, d are non-adjacent). 

Example 4.4. We show in Figure [6] the examples of chain graphs which 
violate the conditions of Lemma 14.31 These graphs have only one chain 
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component C and its parent set. In Figure [6l-(l), the subgraph He is not 
decomposable. In Figure [6l- (2), c and d are not separated by chc(a) \ cd = ^ 
because of a path c — b — d. In Figure [6l-(3), c E chc(a) \ chc(6) and 
d £ chc(6) \ chc(a) are adjacent. Thus c and d are not separated by 
chc(a) ch(7(6) \cd = e. Their closure graphs are shown in Figure El These 
figures show that they are not decomposable, which implies that the graphs 
in Figure [6] are not equivalent to any directed acyclic graph from Proposition 

These facts show that it is sufficient to consider a minimal triangulation 
of -ff(7upa(c) fo'^ each chain component C G Ch instead of the whole H. In 
fact, if a CG model induced by H coincides with none of DAG models, then 
at least one of the conditions (i), (ii) or (iii) in Lemma [4.3l is violated. When 
these conditions are violated, by adding edges between vertices in some C or 
between a vertex in C and a vertex in pa(C), we can satisfy these conditions 
without adding any other edges. Note that the set of chain components 
and the parent set for each chain component in a minimal triangulation 
are identical with these of the input graph. Conversely, a graph obtained 
by minimal triangulation for each -ffcupa(c) > G Ch, is clearly a minimal 
triangulation of H. 

Remark 4.5. The above argument shows how to calculate minimal triangu- 
lations of chain graphs. Let H he a chain graph and G =H{C) be a closure 
graph of a chain component C G Ch- For a minimal triangulation G' of G, 
put F = E{G') \ E{G). Then a minimal triangulation -f^^ypa((7) of -ffcupa(c) 
is obtained by adding edges (a, b) such that for a — b £ F 

• a,b £ Ci for some i, then a — b, and 

• if a G Gi, b G Cj for some i < j, then a ^ b, 

where Gi, . . . ,Gm are the ordered chain components in H. We obtain a 
minimal triangulation H'oi H by calculating -f^(7upa(c) ^'^^^y G Ch in 
this way. 

Example 4.6. Consider minimal triangulations of the graphs in Figure [6l 
Examples of minimal triangulations of closure graphs (Figure [7|) for these 
graphs are shown in Figure [HI In Figure [8l-(l), a minimal triangulation 
of the closure graph is obtained by adding the edge c — e. Since c and e 
belong to the same chain component, adding the edge c — e gives a minimal 
triangulation (Figure [9]-(l)) of the chain graph in Figure [6]-(l). In Figure 
[8l-(2), the edge a — 6 is added. Since a and b belong to different chain 
components and there are directed edges from the chain component of a to 
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(1) (2) (3) 

Figure 8: Examples of minimal triangulations of Figure [71 




(1) (2) (3) 

Figure 9: Examples of minimal triangulations of Figure [6l 

that of b, a minimal triangulation (Figure [9l- (2)) of the graph in Figure [6]- (2) 
is obtained by adding the edge a ^ b. As for the conditions of Lemma 14.31 
c _LL d I (ch /f^c'(a) \ cd) [He] holds because ch/f^c'(a) \ cd = b. In Figure [H]- (3), 
we add the edge a — d, hence, obtain the graph in Figure [9]-(3) in the same 
way as (2). Since chn^cib) \ chff^c'(a) = in this graph, the condition (iii) 
is satisfied automatically. 

The following lemma immediately holds from the above discussion. 

Lemma 4.7. For a chain graph H and a chain component C € Ch, assume 
that H{C) is decomposable. Then for every minimal triangulation H' of H , 
we have Fcupa^{C) = ^cupa^,(C)- 

Corollary 4.8. For a chain graph H and a subset K N of the vertex set, 
assume that -fran(A') equivalent to some directed acyclic graph. Then for 
every minimal triangulation H' of H, Hi^^HiK) = ^Ln^i^^^ holds. 

Proof. Evidently, siiH{K) = sn^'iK) holds. Also, for every chain compo- 
nent C G the closure graph ff(C) is decomposable from Proposition 
14. 2[ Hence, from Lemma 14.71 for every minimal triangulation H' , we have 
-f^Cupa^CC) = -H'cupa^/CC)' ^^^^^ implies the corollary. □ 

As for separations of a chain graph and its minimal triangulation, we 
have a similar result to Lemma l3.1l for undirected graphs. 
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G 




G' H+ 
Figure 10: A construction of from a chain graph H in Lemma l4.9 



Lemma 4.9. For every chain graph H and triplet {A,B \ C) € Mh, there 
exists a minimal triangulation H' of H such that {A, B\C) ^ -Mh' ■ 

Proof. As in the case of undirected graphs, it suffices to find a triangulation 
H' which satisfies {A, B\C) e Mh> ■ 

Prom the definition of the separation criterion of a chain graph, we have 
{A,B\C) G Mg for G = {H^^^abc)T°' ■ Then by Lemma O there exists 
a minimal triangulation G' of G such that {A,B \ C) E Mq'- We construct 
a chain graph from G' as follows (see Figure [TOl) : 



• if n — w € E{G') and u,v (z Gi for some i, then u — w € E{H^) 

• if u — V G E{G') and u E Cj,f G Gj for some i < j, then u - 

• iiu — ve E{H), then u — ve E{H+), 

• if u -u € E{H), then n u G E{H+), 



V G 



where Ci, . . . , Cm are the ordered chain components in H. From this con- 
struction, we have anH+{ABG) = anniABC) and G' = (H^^ 

Let H' be a minimal triangulation of (which may be itself). Then, 



is decomposable, H, 



an^+ (ABC) 



H' , . from 
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CorollaryiS Therefore, we have G' = iK^^^^^^c))"^"' = (^L,,(ABC))"°^ 
which imphes that {A, B\C) e Mh'- □ 

4.2 Definition and properties of standard imsets for chain 
graphs 

In this section, we define a standard imset for a chain graph and show that 
it fully represents the CG model induced by this graph. 

When a chain graph H is equivalent to some directed acyclic graph, its 
standard imset is defined as follows [181 IS] • 

iS)-Ss}. (8) 

This definition is a generalization of that of a directed acyclic graph ([2]) and 
a decomposable graph ([3]). Moreover, we have the following lemma about 
this imset: 

Proposition 4.10. (Studeny et al. fl9^) Assume that two chain graphs 
Hi,H2 are equivalent to some directed acyclic graph. Then Mhi = 
and only if uhi = ■ 

Therefore, for a chain graph H which is equivalent to some directed 
acyclic graph, we have uh G C{N) and M.h = J^uh from Lemma 12.61 
Furthermore we have the following corollary from Lemma 12.91 

Corollary 4.11. Suppose that a chain graph H is equivalent to some di- 
rected acyclic graph and let uh he given in ([8|). For a triplet {A^B\C) G 
T{N), the followings are equivalent: 

(i) {A,B\C)(^Mh, 

(ii) UH - U{A,B\c) e C(iV), 
( Hi) UH - u^A,B \c) G 5(iV) . 

Note that every closure graph H{C), C G Ch-, is decomposable from 
Proposition 14.21 Thus ([8]) is also written as 

UH = - h + E {"^PaCC) - ^Cpa.{C) + ""^(0) } ' 
CdCu 

where ujj^fj^ is the standard imset ([2]) for the decomposable graphi/(C). This 
equation suggests that a generalization of ([8]) is given by replacing Ujj^fj-^ as 

dS]). For C G Cjy and y C C u pa(C), let H{C)v be the induced subgraph of 
the closure graph if(C) by V. 
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Definition 4.12. A standard imset uh for a chain graph H is defined by 



UH = sn - + {i^i 

cec„ 



(9) 



where Ujjf^^jyC € C//, is the standard imset for the undirected graph i?(C) 
given by dGj): 



SeSn 



+ E E 

This imset gives a representation of CG models. The proof is similar to 
the case of undirected graphs. 

Theorem 4.13. For a chain graph H , let a standard imset uh for H be 
defined by Then uh € C.{N) and M.h = -Muh- 

Proof. The argument in the last section implies that Ch = Ch' and paj:^(C) = 
paj^/(C), VC € Ch-, for a minimal triangulation H' of H. Thus a standard 
imset Ufji for H' given by ([8]) is 

Uw =5n-5^+ E { - ^Cp^„,[C) + %'(C7)} 

= <57V - <50 + E { - ^CpaH(C) + %'(C)}- 

As in the proof (of implication Adn C Adug) of Theorem 13. 7[ we have 



''h'{C) ^ '^(-^) fo'- ^ ^ which shows that uh — Ufj' € S^N). 



Also, putting vh = ^H'e%{H) "^H'l we have 

VH = E '^A' - '^0 + E {'^Pa(C) - -^CpaCC) + %'(c)} 



mH)\ 



E {V(C)-'^C;pa(C)} + E E 



H'£%{H) CgCh 



5n - E {'^Pa(C) - ^Cpa.{C) 

CeCu 
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+ Yl riHiC,G)-UG, 

cgCh GeX(i?(C)) 

where nH{C,G) = \{H' e %{H);H' {C) = G}| for C7 G Ch and G e 
is the number of minimal triangulations H' of H such that H (C) = G. 
Therefore, as in the proof of the case of an undirected graph, uh and vh 
belong to the relative interior of the same face of cone(£'(A^)). Thus we have 
= My^. 

For every chain graph, there exists a discrete measure P over such 
that Mv = Mh [151. Moreover Theorem 12.31 implies that M-p = Mw for 
some w € S{N). Hence for every H' € %{H), we have 

Mu„, = Mh' ^ Mh = Mp = My,, 

which implies that ku' ■ w — uh' G S{N) for some kni G N from Lemma 
12.21 Putting k = Yl,H'e%{H) ^H'-, we have k ■ w — vh G S{N). Therefore 
MuH = ^ My, = Mh- 

Conversely, for every {A,B\C) € Mh^ there exists H' € ^{H) such 
that {A,B j C) € Mh> from Lemma l49l Thus uh' — ^(a,_b|c> ^ S{N) from 
Corollarv 14.111 Hence we have 

UR - U(^A,B I C) = {uH -UH') + {UW " U(^a,B \C)) ^ S{N) 

and {A,B\C) Muh- □ 
As in the case of undirected graphs, we have the following corollary: 

Corollary 4.14. For a chain graph H and every triplet {A,B \ C) € T{N), 
the fallowings are equivalent: 

(i) {A,B\C)eMH, 
(a) UH - U(^A,B\c) e C{N), 
(Hi) UH-U(^A,B\c) ^S{N). 

4.3 Feasible merging 

From now on, we will consider the uniqueness of the standard imsets for 
chain graphs in Definition 14.121 

In the case of chain graphs which are equivalent to some directed acyclic 
graphs, the uniqueness of their standard imsets defined by ([8]) is given in 
Proposition 14.101 Its proof is based on the concept called a feasible merging 
[T9j . In this section we review its definition and properties. 
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Let H he a chain graph. A pair of its chain components U,L ^ Ch is said 
to form a meta-arrow U ^ L \i there exists a directed edge a b E[H) 
for some a U,b L. Merging of a meta-arrow U ^ L is the operation 
of replacing every directed edge a ^ b G E{H), a & U,b & L, with a — b. 
Merging of [/ ^ L is called feasible if the following two conditions are 
satisfied: 

(i) K = pa{L) n [/ is a clique in H, and 

(ii) pa(L) \ U CI pa(6) for any b £ K. 

By this definition, merging is feasible if and only if pa(L) is a clique in the 
closure graph H{U). Moreover, for the resulting graph H' and the chain 
component M obtained by merging of U ^ L, paff{L) is a clique in if (M). 

Example 4.15. We show some examples of feasible and infeasible merging 
in Figure [TTl The left-hand side graphs of these figures are input graphs 
containing K = {b,c},L = {d,e} and pa(-L) = {a,b,c}, and the right-hand 
side graphs the resulting graphs obtained by merging U ^ L in the input 
ones. In Figure (1), K is a clique, and pa(L) \ U = {a} = pa(6) C pa(c). 
Thus both conditions are satisfied, and merging is feasible. Especially, the 
input graph and resulting graph have the same complexes. In Figure (2), 
since K is not a clique, the condition (i) is not satisfied. Also in Figure 
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(3), the condition (ii) is violated because pa(L) \ U = {a} ^ pa(c). Hence 
merging of L'^ ^ L in (2) and (3) is infeasible. Note that, in Figure (2), 
merging oiU ^ L destroys a complex h ^ d — e c. Similarly, a complex 
a ^ d — e ^ c vanishes in Figure (3). As in Figure (3), the condition (ii) 
is not satisfied in (4). In this case, the resulting graph has a directed cycle 
a— >-d — e — c— >a, and hence, it is not a chain graph. 

As shown in these examples, the resulting graph by feasible merging is 
also a chain graph and has the same complexes as the input graph. Thus, 
we have the following important lemma from Theorem 12. 4i 

Lemma 4.16. (Studeny et al. ]1S^ ) Let H he a chain graph and H' be a 
graph obtained by merging of U ^ L in H. Then Mh = M.H' if o-nd only 
if merging is feasible. 

The operation of merging can be performed without leaving the equiva- 
lence class. Especially, every larger equivalent graph is obtained by a series 
of feasible merging operations. 

Theorem 4.17. (Studeny et al. 1191) Let G and H he chain graphs such 
that A4g = Mh and H > G. Then there exists a sequence of chain graphs 
G = Hi, . . . ,Hr = H, r > 1, such that -ffj+i is obtained by the operation of 
feasible merging in Hi for all i = 1, . . . ,r — 1 . 

From Theorem 12. 5 1 for proving that equivalent chain graphs have a com- 
mon property, it suffices to prove that the property is shared by a pair of 
graphs of the class such that one is obtained by feasible merging in the other. 

4.4 Uniqueness of standard imsets for chain graphs 

In this section, we show that equivalent chain graphs have the same standard 
imset. 

Theorem 4.18. Let Hi,H2 be chain graphs. Then A4hi = if ^''^^ 

only if = ■ 

To prove this theorem, the following fact is useful: 

Lemma 4.19. (cf. the proof of Theorem 20 in flS^) For a chain graph H 
which is equivalent to some directed acyclic graph, let H' be a graph obtained 
from H by feasible merging of a meta-arrow U ^ L, and let M denote the 
merged chain component. Then K Q N is a maximal clique of H (M) if and 
only if it is either a maximal clique of H{L) or a maximal clique of H(U) 
different from pa^^ (L) . 
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In a chain graph H which is equivalent to some directed acychc graph, 
every mp-subgraph ofH{C),C G Ch, is complete, because a closure graph 
H{C) is decomposable. As mentioned in Section 12.21 the graph obtained by 
adding edges to an undirected graph such that its all mp-components are 
cliques is decomposable. Hence, let H be the graph obtained by adding 
edges to H so that all mp-components V € for every chain component 

C € Ch are cliques. Then H is a. chain graph which is equivalent to some 
directed acyclic graph and we have the following result adapting the above 
lemma to H: 



Lemma 4.20. For a chain graph H, define H' and M as in Lemma \4-19 



Then K C N is an mp-component of H (M) if and only if it is either an 
mp-component of H{L) or an mp-component of H{U) different from pa fj{L). 

We now prove Theorem 14.181 using this result. 



Proof of Theorem \4-18 . Let H = Hi. Then the standard imset for H given 
by dlD is 

^xj/ = (Jat - J0 + ^ |(5pa(c) - ^ + ^(C)('S') ■ ^5} 

+ E E E 

In this equation, the first three terms are the standard imset for a graph H 
which is mentioned above. From Proposition 14.21 H is equivalent to some 
directed acyclic graph. For the graph H', we define H' in the same way. 
Then we have Ujj = Ujj, from Proposition 14. lOl Moreover, since the closure 
graphs for every chain component C except for U, L, M are the same in H 
and H', uh = uh' is reduced to 

E E E E = E E 

G&{H{L)v) y(^^H(u) G&%{H{U)v) ^eHi'(M) Ge%(H'(M)v) 

(10) 

From Lemma r4.201 mp-components in h'{M) except for 'pajj{L) are identical 
with that of either H(L) or H{U). Also, since pa(L) is a clique, letting 
V = pa(L), we have 

E = XI " E UG = 0. 

G&(H{U)v) G&(H{L)v) Ge%{H'{M)v) 
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Therefore (jlOp holds whether pa(L) is an mp-component oiH{U) otH'(M) 
or not. 

Let Hoo be the largest chain graph in the equivalence class containing 
Hi , H2 ■ Then we have uh^ = uh^ from Theorem I4.17[ Also we have 
UH2 = ""Hoo ) which implies Theorem 14.181 □ 

5 Concluding remarks 

In this paper we defined standard imsets for undirected graphical models and 
chain graphical models. The crucial concept to derive them was a minimal 
triangulation. For an undirected graph, its imset was defined through all 
minimal triangulations of the graph. Moreover, we gave a more brief form of 
a standard imset using the structure of mp-subgraphs. For a chain graph, we 
generalized a triangulation of undirected graph. Then a standard imset for 
a chain graph was derived through an analogous argument as the undirected 
case. We also showed the uniqueness of standard imsets for equivalent chain 
graphs. 

For directed acyclic graphs and decomposable graphs, the number of 
non-zero elements of their standard imsets is linear in |A^|, while ^ and Q 
may have exponential number of non-zero elements. Especially, for a prime 
undirected graph, imsets defined by @ coincide with Thus there is a 
question whether we can find an imset with smaller numbers of non-zero 
elements. 

This is related to the degree of combinatorial imsets. The degree of a 
combinatorial imset is defined as the sum of positive coefficients when it 
is written as a non-negative integer combination of elementary imset |17j. 
An imset with the smallest degree is considered as a basic representative of 
an equivalence class in Section 7.3 in [17]. In fact, a standard imset for a 
directed acyclic graph has the smallest degree. Our definition of a standard 
imset has the smallest degree for some graphs. One of such examples is a 
4-cycle graph. It is easy to see that the smallest degree in the equivalence 
class is 2, and ^ achieves this bound. Although, for other cycle graphs, dH) 
does not achieve the smallest degree, it may be possible to derive an imset 
with the smallest degree through our definition. 

References 

[1] S. A. Andersson, D. Madigan, and M. D. Perlman: On the Markov 
equivalence of chain graphs, undirected graphs, and acyclic digraphs. 



27 



Scandinavian Journal of Statistics, 24, no.l, pp. 81-102, 1997. 

[2] R. R. Bouckaert, R. Hemmecke, S. Linder and M. Studeny: Efficient 
algorithms for conditional independence inference. Journal of Machine 
Learning Research, 11, pp. 3453-3479, 2010. 

[3] D. Geiger, and J. Pearl: Logical and algorithmic properties of con- 
ditional independence and graphical models. Annals of Statistics, 21, 
no.4, pp. 2001-2021, 1993. 

[4] M. Frydenberg: The chain graph Markov property. Scandinavian Jour- 
nal of Statistics, 17, no.4, pp. 333-353, 1990. 

[5] H. Hara, and A. Takemura: A localization approach to improve iterative 
proportional scaling in Gaussian graphical models. Communications in 
Statistics Theory and Methods, 39, no. 8, pp. 1643-1654, 2010. 

[6] P. Heggernes: Minimal triangulations of graphs: A survey. Discrete 
Mathematics, 306, pp. 297-317, 2006. 

[7] R. Hemmecke, J. Morton, A. Shiu, B. Sturmfels, and O. Wienand: 
Three counter-examples on semi-graphoids. Combinatorics, Probability 
and Computing, 17, pp. 239-257, 2008. 

[8] R. Hemmecke, S. Linder, and M. Studeny: Learning restricted Bayesian 
network structures, preprint (2010). arXiv:1011.6664vl. 

[9] S. L. Lauritzen, A. P. Dawid, B. N. Larsen, and H. G. Leimer: In- 
dependence properties of directed Markov fields. Networks, 20, no. 5, 
pp. 491-505, 1990. 

[10] S. L. Lauritzen: Graphical Models. Oxford University Press, Oxford, 
1996. 

[11] H. G. Leimer: Optimal decomposition by clique separators. Discrete 
Mathematics, 113, pp. 99-123, 1993. 

[12] T. Ohtsuki, L. K. Cheung, and T. Fujisawa: Minimal triangulation of 
a graph and optimal pivoting ordering in a sparse matrix. Journal of 
Mathematical Analysis and Applications, 54, pp. 622-633, 1976. 

[13] J. Pearl: Probabilistic Reasoning in Intelligent Systems - Networks of 
Plausible Inference. Morgan Kaufmann, San Francisco, 1988. 



28 



[14] M. Studeny: Description of structures of stochastic conditional inde- 
pendence by means of faces and imsets (a scries of three papers). Inter- 
national Journal of General Systems, 23, no. 2-4, pp. 123-137, 201-219, 
323-341, 1994/1995. 

[15] M. Studeny, and R. R. Bouckaert: On chain graph models for descrip- 
tion of conditional independence structures. Annals of Statistics, 26, 
no.4, pp. 1434-1495, 1998. 

[16] M. Studeny: On non-graphical description of models of conditional 
independence structure. In HSSS Workshop on Stochastic Systems for 
Individual Behaviours, Louvain la Neuve, Belgium, 2001. 

[17] M. Studeny: Probabilistic Conditional Independence Structures. 
Springer- Verlag, London, 2005. 

[18] M. Studeny, and J. Vomlel: A reconstruction algorithm for the essential 
graph. International Journal of Approximate Reasoning, 50, pp. 385- 
413, 2009. 

[19] M. Studeny, A. Roverato, and S. Stepanova: Two operations of merg- 
ing and splitting components in a chain graph. Kybemetika, 45, no.2, 
pp. 208-248, 2009. 

[20] M. Studeny, J. Vomlel, and R. Hemmecke: A geometric view on learn- 
ing Bayesian network structures. International Journal of Approximate 
Reasoning, 51, pp. 573-586, 2010. 

[21] T. Verma, J. Pearl: Causal networks: Semantics and expressiveness. 
In Proceedings of the 4th Uncertainty in Artificial Intelligence, North- 
Holland, pp. 69-76, 1990. 

[22] J. Vomlel, and M. Studeny: Graphical and algebraic representatives of 

conditional independence models. A chapter in Advances in Probabilis- 
tic Graphical Models, Springer, pp. 55-80, 2007. 



29 



